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Abstract 

We establish a large deviation principle for the solutions of a class of 
stochastic partial differential equations with non-Lipschitz continuous 
coefficients. As an application, the large deviation principle is derived 
for super-Brownian motion and Fleming- Viot process. 
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1 Introduction 

Measure- Valued processes (MVP) arise from many fields of applications in- 
cluding population growth models and genetics. We refer the reader to the 
books of Dawson [2], Etheridge [8], Perkins [15], and Li [1^ for an introduc- 
tion to this topic. Two of the most studied measure-valued processes are 
super-Brownian motion (SBM) and Fleming- Viot process (FVP). An inter- 
esting problem concerns the limiting behavior of these processes when the 
branching rate (for SBM) or the mutation rate (for FVP) e, tends to zero. 
It is easy to see that the measure- valued processes, denoted by fil, converge 
to a deterministic measure- valued process n^, and it is desirable to study 
this rate of convergence. 

Large deviation principle (LDP) is a very useful tool for the study of 
convergence rate. Roughly speaking, the goal of the LDP is to determine 
the rate R{d) > 0, for any 5 > such that as e — )• 0, 

P(p(m%/) > 5) «exp (-6-1/2(5)), (1) 
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for a suitable distance, p in C ([0, 1]; A^/3(M)), the state space of the MVP, 
where M.js{M.) is the set of u-finite measures ^ on M such that 

J e-^l^ld;u(drc) < oo. (2) 

We refer the reader to the books of Dembo and Zeitouni [5], Deuschel and 
Stroock [6], and Dupuis and Elhs [71 for more background on this subject. 

LDP for MVP has been studied by many authors. Fleischmann and 
Kaj [11] proved the LDP for SBM for a fixed time t. Later on, sample 
path LDP for SBM was derived independently by Fleischmann et al |10], 
and Schied [16] while the rate function was expressed by a variational form. 
To obtain an explicit expression for the rate function, [lOj assumes a local 
blow-up condition which is not proven. On the other hand, [16j obtains 
the explicit expression of the rate function when the term representing the 
movements of the particles also tends to zero. The local blow-up condition 
of [10] was recently removed by Xiang for SBM with finite and infinite 
initial measure, [20], [19| respectively, and the same explicit expression was 
established. Fleischmann and Xiong [12j proved an LDP for catalytic SBM 
with a single point catalyst. The successes of the LDP for SBM depend 
on the branching property of this process. This property implies the weak 
LDP directly, and hence the problem diminishes to showing the exponential 
tightness of SBM, which yields the LDP, and identifying its rate function. 

Since FVP does not possess the branching property, the derivation of 
LDP depends on new ideas. Dawson and Feng [1], [3], and Feng and Xiong [9j 
considered the LDP for FVP when the mutation is neutral. In [4], LDP was 
shown to hold when the process remains in the interior of the simplex, and 
in [3] the authors proved that if the process starts from the interior, it will 
not reach the boundary. On the other hand, authors in [9] focused on the 
singular case when the process starts from the boundary. For non-neutral 
case, Xiang and Zhang [2lJ derived an LDP for FVP when the mutation 
operator also tends to zero by projecting to the finite dimensional case. 

The goal of this paper is to study LDP for MVP, with SBM and FVP as 
special cases. Comparing our LDP for SBM with that obtained in [10], |16j 
and [H], the rate function has the same explicit representation, but the 
approach is different. Our LDP for FVP contributes to the literature, by 
not requiring the neutrality and vanishing of mutation. 
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2 Notations and Main Results 



Let (0, P, J-t) be a stochastic basis satisfying the usual conditions of right 
continuity and completeness. Suppose W is an 7"j-adapted space-time white 
noise random measure on x U with intensity measure dsX{da), where 
{U,U,X) is a measure space. 

We consider the following stochastic partial differential equation (SPDE): 
for e > 0, t G [0,1], and yeR, 

u\{y) = F{y) + Ve f [ G {a, y, ul{y)) W{dsda) + f lAul{y)ds (3) 
Jo Ju Jo ^ 

where F is a function on M and G : f7 x — )• M satisfies the following 
conditions: there exists a constant K > such that for any ui,U2,u,y S M, 

\G{a, y, ui) - G{a, y, U2)\^ \{da) <K\ui- U2\ (4) 

and 

f \G{a,y,u)\^\{da)<K{l + \u\'^) . (5) 
Ju 

This SPDE was studied by Xiong [22j in a Hilbert space denoted by him as 
Xo- To study the LDP for the random field {ti^(y)}, we need to consider the 
SPDE in a certain Holder continuous space; that is, we study the regularity 
of the solution. For this purpose the spaces for the solution are introduced. 
Let {(t>j}j>i be a complete orthonormal system (CONS) of L'^{U,U,X) and 
define a system of stochastic processes as, 

= f I <Pj{aW{dsda), j = 1, 2, • • • . (6) 
Jo Ju 

which by Levy's characterization of Brownian motions, is a sequence of 
independent Brownian motions. Denote the measurable space, 

(5,S) := (C([0,1];M-),B(C([0,1];M°°))). 

For any a € (0, 1) and < /3 G R, let the space, Ma^p be the collection of all 
functions / : M — t- M such that for all m G N, 

\f{yi)- f{y2)\<Ke^'^\yi-y2\'' , V|yi|, jyal < m, (7) 

and 

\f{y)\<KeP\y\, VyGM. (8) 



J. 
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We define the metric on Ba^/j as follows: 

oo 

da,l3iu, 'V) = ^ (||n - V\\m,a,l3 A 1) , U, V £ Bq,,/3 

m=l 

where 

||n|U,.,, = supe-/^N|.(x)|+ sup K^i)^^^-,., 

Notice that SPDE ^ can be rewritten as an SPDE driven by Brownian 
motions, {B^} as follows: 



iliy) = F{y) + ^^Y.[ ^^(2/' <iy))dBi + \^ 



ul{y)ds, (9) 



where 

Gj{y,u)= [ Gia,y,u)cPj{a)Xida), j = l,2,---. (10) 
Ju 

In this paper, we let (3q G (0,/3). 

Theorem 1. For any a € (0, ^), i/iere exists a measurable map, g'^ : Bq-^/Jq x 
S — )• C([0, 1]; Bq,^/3) such that for F £ ^a,i3o, = 9'^ {P, V^B) is the unique 
mild solution of 

In order to study the LDP of the process tif , one needs to consider the 
controlled version of ([3]) with the noise replaced by the control. For any 
h G L2([0, 1] X U,ds\{da)), this version has the following deterministic form, 

ut{y) = F{y)+ [ [ G{a,y,Us{y))hs{a)\{da)ds+ [ ^Aus{y)ds (11) 
Jo Ju Jo ^ 

Because of the non-Lipschitz continuity of the coefficients, the topology of 
the state space, C ([0, l];Ba_/3), needs to be modified. 

Definition 1. We say that u,v G C([0, 1]; B^^^) are equivalent, denoted by 
u ^ V, if there exists an h £ -^^^([0, 1] x U,dsX{da)) such that both u,v are 
solutions to If u is not a solution to equation ( li jj) for a suitable h, 

then u belongs to the equivalent class consisting of itself only. 

From this point on, we establish the LDP of u"^ in the quotient space of 
C([0, 1];Bq,^^) under the equivalence relation ~ given above. We abuse the 
notation a bit by using the same notation for this quotient space. Note that 
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when h = 0, equation (jlip has a unique solution, u^{y). Therefore, this 
modification of topology does not affect the exponential rate of the form ([T|) 
derived from the LDP at a neighborhood of u^. 

Let 7 be a map from B^./^o x -^^([0,1] x U,dsX{da)) to (:([0, 1]; B^,/?) 
whose domain consists of {F, h) such that has a solution, and denote 
the equivalence class of the solution as n = j{F, h). 

Theorem 2. Suppose F G Bcj,^g, then the family {u^} satisfies the LDP in 
C([0, 1];Bq,^^) with rate function, 



I{u) 



iinfj^ j \hs{a)\^X{da)ds ■.u = -i{F,h)^ 3h s.t. u = j {F,h) 
oo otherwise. 

(12) 



We now apply Theorem 2 to SBM and FVP. Suppose {^^} is an SBM 
with branching rate e. As indicated by Xiong [22], for all y G M, 



<{y)= [\t{dx) (13) 
Jo 

is the unique solution to SPDE ^ with 
ry 

^{y) — / l^oidx), [/ = M, X{da) = da and G{a,y,u) = la<u- (14) 



Assume D is the Schwartz space of test functions with compact support 
in M and continuous derivatives of all orders. Denote the dual space of real 
distributions on M by P*. Similar to [K)j, for a fixed i' £ A^/3(M), let the 
Cameron-Martin space, Hu, be the set of measures /i G C([0, 1]; A^^(R)) 
satisfying the conditions below. 

1. ^0 = I', 

2. the P*-valued map t ^ fit defined on [0,1] is absolutely continuous 
with respect to time. Let fi and A*// be its generalized derivative and 
Laplacian respectively, 

3. for every t G [0,1], fit — ■^A* fit G P* is absolutely continuous with 

respect to fit with '^^^^ being the (generalized) Radon Nikodym 

derivative, 

4- is in L2([0,1] x R,dsfi{dy)). 
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The topology of 7W/3(R) is defined by the fohowing modified weak con- 
vergence topology. We say that /i" — )• /i in A^^(R) if for any / G Ch(R), 



/(x)e-''l^lM"(dx) ^ / /(x)e-'^l^l^(dx). 



Theorem 3. If fio G A^/3(M) such that F G ffia,/3o; ^^^n {/i'^} satisfies the 
LDP on C([0, 1]; A^^(M)) raie function, 



oo 



(/it - iA*/7,t) {dy) 



^t{dy)dt ii fj, £ Hf 



W) (15) 
otherwise. 



As for FVP, if {fJ-'^} is an FVP, then ul is defined as 

uliv) = fili{-oo,y]) 

for all y G M, and by this definition, ul is the solution of SPDE ([3]) with 

-^(y) = /^o((-oo,y]), [/=[0, 1], \{da)=da and G{a,y,u) = la<u - u. 

(16) 

In this case, let H^, be the space for which conditions for H^j hold with M p (M) 



replaced by Vt 



M, 



n 



the collection of Borel probability 



measures on M, and with the additional assumption 

[fit - ^A*/Xi) {dy) \ 



Mdy) 



0. 



Theorem 4. Suppose fiQ G ^^3(1^) such that F G ^a,/So- Then, {fi'^} satisfies 
the LDP on C([0, with rate function, 



00 



(/it - iA>t) (dy) 



fit{dy)dt ii fj, £ Ilf 



wi (17) 
otherwise. 



Proofs of Theorems 1-4 will be given in Sections 3-6. Throughout the 
rest of this paper, K will denote a constant whose value can be changed 
from place to place. 
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3 Regularity of SPDE 



This section is devoted to the proof of Theorem 1. For the simphcity of 
notation, we take e = 1 and denote u'j.{y) by ut{y). The solution to SPDE 
([3|) can then be written in the following mild form, 



My) 



Pt{y — x)F{x)dx 



+ 



u 



Pt-s{y — x)G{a, X, Us{x))W {dsda)dx (18) 



where pt{x) = ^^—^ exp %j is the heat kernel. Here we refer to the first 

term on the RHS of ([T8|) by u^{y), and the second term by vt{y). 

The following lemma offers an estimate that is the starting point for 
other more refined estimates of the solution. The proof is identical to that 
of Lemma 2.3 in [22] so we omit it. 

Lemma 1. For any n > 2 and /3i G (/3o,/3), we have 



M 



sup E 

0<s<l 



< oo. 



(19) 



Inspired by Shiga [T7] , to obtain the regularity of the solution to SPDE 
(fT8]l and for its tightness to be used in a later section, the following refined 
version of Kolmogorov's criterion is proved and applied. 

Lemma 2. Let {ul{y)} be a sequence of random fields and suppose /3i G 
(/3o,/3). If there exist constants n, q, K > such that 



E Kiyi) - ^t.(y2)r < ife^/^^d^^l^l^^l) {\yi - y2\ + |ti - t2|)'+'' : 
then, 



(20) 



supE 

e>0 



sup sup --J — — -j-^e P 

t»e[0,l],|y,|<m,i=l,2 \\yi - 2/2| + \tl - t2\) 



< OO. 



(211 



Furthermore, i/supE |'u^jj(yo)|" < oo for some {tQ,yo) G [0, 1] x M, then 

e>0 



supE 

e>0 



sup e 



ut{y)\ 



< oo. 



(22) 



With the above additional assumption, the sequence {u*^} is tight inC([0, 1];]Bq,./3) 
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Proof. For i = 1,2, let := and uHy'j) := ul{yi). By the hypothesis, 

E|u,^^(y;)-n^^(y^)|" = E\ulimy[)-ul^imy',)\'' 

< ^en/3i(|j;i|v|,2|) |y/ _ 1 ^ _ ^^q2+, 

< /^m2+5e'^/^l-(|y;-y^|+|^l-^2|)'+^ (23) 

By Kolmogorov's criterion (cf. Corollary 1.2 in Walsh |18j). there exists a 
random variable Ym such that < Xm^^'^e"'^^"^ and 

- ^,^,(^2)1 < {\y'i - V2\ + |ii - ^21)''/" 

therefore, 

K(yi)-^t2(y2)| <i;n(|yi-y2| + |ii-i2ir/". (24) 

Let Y := sup{y™e-''™}. Then, 

m 

Ey" < E^y^e"'^'"" (25) 

m 

= ^Ey^^e"''™" 

< J]i^m2+5e-(/^-/^i)™" <oo. 



Thus, y is a finite random variable, and (|24p implies 

|<i(yi) - ^^,(^2)1 < I'e'^" (|yi - y2\ + |ti - Hr'"" ■ (26) 

Now, we suppose there exists {to,yo) G [0, 1] x M such that 

sup E 1^^^(2/0)1" < oo. 

Note that ([26|) remains true with /3 replaced by /32 G (/3i , /3) . For the sim- 
plicity of notation, we choose to = 2/0 = 0. Taking h = t, yi = y and 
^2 = 2/2 = in ([26]) , gives 



\nt{y)\<\um\+ye^''^{\y\ + \t\f''- 
Suppose that |y| < in. Then, 

e-f^\y\\ul{y)\ < e-'^ls^l|n^(0)|+ye-('^-^2)|y|g/32(|y| + |i|)g/n 



< (e-*IJ'l|n^(0)| +y 
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for a suitable constant K (independent of m). Inequality (j22p then follows 
easily. 

Uniform boundedness and equicontinuity are implied by (p2|) and (f2T]) . 
respectively. Therefore, tightness of the sequence follows from Arzela-Ascoli 
and Prohorov theorems. □ 

The following lemmas illustrate and Vt are included in Bcr,/3 space. 
These lemmas along with the result in [22] on existence and uniqueness of 
a mild solution to SPDE ([3]), prove Theorem 1. 

Lemma 3. is an element o/ C([0, 1]; Ba,/3). 

Proof. Suppose t G [0, 1] and yi,y2 are any real numbers such that \yi\ < m 
for i = 1,2. Let be a Brownian motion. Then, 

Choosing 7 > such that (1 + 7)/3o < /3 gives, 
|n?(yi)-n0(y2)| < E\F{yi - Bt) - F{y2 - Bt)\ 



= 1^(2/1 - Bt) - F{y2 - Bt)\ lim7<|Bt|<(j+l)7m 

j=0 

00 

< i^e((^'+^)^+^)*™|yi -y2rP{\Bt\> nm) 



j=0 



00 

j=0 

00 

< Ke'-'^lyi-ysr (27) 
On the other hand, let y in M be fixed such that \y\ < m, then for any 
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< tl < t2 < 1, 



< ¥.\F {y - Bt,) - F {y - Bt,] 



- - Bt^) - F {y - Bt^)\ ljim7<|BtJ<(j+l)m7lj2m7<|Bt2|<(j2+l)m7 



Jl J2 



Estimates ([271) and ([28]) imply that ii° G C([0, 1]; B^,/?). 
Lemma 4. w. taA;es values m C ([0, 1]; Bq,^^), a.s. 



(28) 



□ 



Proof. Similar to the proof of Lemma [3l two cases are demonstrated for this 
lemma. Considering the first case, denote 

G := G{a,x,Us{x)) and Pi := pt~s{yi - x) - pt-s{y2 - x) 

and let t G [0,1] be fixed, while yi,y2 G ^ are arbitrary numbers such 
that \yi\ < m for i = 1,2. Using Burkholder-Davis-Gundy and Holder's 
inequalities, we obtain, 



E 



mPiGdxW{dsda) 



< KE 



< KE 



< KE 




lo JU 

ft 



PiGdx 



n/2 



\{da)ds 

f I I |Pi|'e2/3il-ldx / G\-''^^\^\dx\{da)d 
Jo Ju Jr Jr 

fjt-s{yi,y2) [ {l + \us{x)f)e-^^^^^Uxds 
Jo Jr 



(29) 



s 

n/2 



n/2 
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where 

Jsiyuy2)= / \psiyi - x) - ps{y2 - x)\'^ e^^'^^'Ux 

JR 

is estimated below using the simphfied notation, 

P2 := Ps{yi - x) -Ps{y2 - x). 



Js{yi,y2) 



(30) 



< 
< K 
+K 



1 



2-KS 

1 



{yi - xf - {y2 - xY 



2s 



|Po|2-%2/3i|x|^^ 



2tts 
1 



^27rs 



" \yi - y2nyi + j/2 - 2x|" _ (2-.)(.i-.)^ ^20^^^ 

(25)-(27rs)(2-)/2 " » e 

- y2nyi + y2 - 2x1" .g^i,, 

(2s)"(2^s)(2-")/2 



< i^e2'^i(lfl|V|2/2|)^-{i+a)|y^_y2|a_ 

Note that, we may choose p > 1 such that + a) p < 1 and let q be the 
conjugate index. Then, 



g \ "/(2q) 



< 

< K. 

Plugging (pOj) back into ([29]) and noting ([3T]) to obtain, 

E\vt{yi) - vt{y2)r < Ke^^^^\y^\''\y^\^\yi - ysl' 
Next to prove case two, let y E M and choose any < ti < t2 < 1- Note 



(31) 



, an 
2 , 
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that 



nytM-ytM\' 



(32) 



r Is{tiM) I {l + \us{y)\^)e-^^^\''\dxds 

Jo JR 



n/2 



■t2 r r 




< KE 

+KE. 
where 

Is{tl,t2) := Ilitut2) + lUh,t2), 

liihM) •■= f \pt,-siy-x)-pt,-siy-xrpt,-siy-xf-''e^^^\-\dx 

Jr 

for i = 1,2. We estimate /i(ti,t2) by K + -^i^l^i, ^2)) where 



Jr 

and 



y/ti - S - S 



Pt,-s{y-xf-''^P^\^\dx 



1 



R \/*2 — S 

Now we continue with 

ll\t^M) < K [ 
Jm 

< K 

and 

il'^ihM) < K 



ti — S t2 — S 



t2-tl 



(y - x)'- 



pt,-s{y-xf-''e^^'\-\dx 



y/h - s{t2 - s) 



T^P{ti-s)/i2-a){y - X)dx 



' it2-tir(y-x)2« 



{t2 - S) 2 {ti - s) 

< K ^l^lil^^e2/3i 

{t2 - s) 2 {ti - s) 2 



— P(ti-s)/(2-a)(y - a;)e^'^il'^ldx 



RecaU < < i2 < 1 so for a G (0, i), 
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and 

Jo Jo 

< Ke'^'^'^y^\ti-t2\'', 



where we used the fact that t2 — s > ti — s. Makmg use of p9j) . we see that 
the first term of (p2]) can be estimated above by 

/ i-ti \n/2 
K U {llHtl,t2)+llHtl,t2) + l's\h,t2)+lf{h,t2)) ds) 

< Ke^'l^'^y^lti - t2 



an 
2 



where I^^ and I^^ are defined and estimated similarly as those for I^^ and 
Finally, we consider the second term of (j32|) . Notice that, 



7 

*2 ds 



vl^-siy -x)e^^^\''\dxds < K / Jy -x)dxds 

Jti Jm — s 2'- 



ti JK Jti 



1 7*2 - S 



□ 



Thus, we see that the second term of (l32]l is bounded by 

4 LDP for SPDE 

LDP describes the asymptotic behavior of the sequence {u'^} of the above 
SPDE as e — )• 0. This principle gives the following two bounds. 
LDP Lower bound: For all open sets, U C C([0, l];]Bcjj3), 

liminf elogPfu*^ ^U)> — inf I{x) 

LDP Upper bound: For every closed set C C C([0, 1];]Bq^^), 
limsupelogP(ti'^ € C) < — inf I{x) 
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where / : C([0, 1]; Bq,/?) — ^ [0, oo] is a lower semicontinuous map called a 
rate function. For more introduction to the theory of large deviations, we 
refer the reader to [5], [6] and In this section, we derive the LDP for 
SPDE ([3]) by using the powerful technique developed by Budhiraja et al [1]. 
More specifically, we apply Theorem 6 of that paper with £q := Ba^/^p and 

£: :=C([0,1];B,,;3). 

Recall from Section 2, the definition of the map 7 and let g'' be the map 
given in Theorem 1. Denote 

5^ (^2) := |a; G L\[0, 1] : £2) : \\ks\\lds < ivj 

and define a map C from k £ 5^ (^2) to h = C(/c) G ^^([0, 1] x U) as follows: 

j 

Let (7O : M^^p^ x 5 ^ C([0, 1] : B„,^) given by, 

<70(^F,^'Ms) =7(i^,C(^)). (33) 

To obtain the LDP, it is sufficient to verify Assumption 2 imposed by [1]. 
Suppose {A;^} is a family of random variables taking values in (£2) such 
that ^ k in distribution and F*^ — )• -F as e — )• 0. Denote the solution to 

Jr ■ Jo Jr 

+ f f Pt-s{y-x)Gj{x,Us{x))kl'^dxds (34) 
j -JO Jr 

as u^' (y), where Gj{y,u) is defined in Section 2. 

Lemma 5. {u^'*^} is tight in C ([0, 1];Bq^^). In particular, Assumption 2 
of |IJ/ holds under the current setup. 

Proof. To prove the tightness of {u^''^}, we need to determine estimates for 
u^''^ similar to those obtained in Section 3. Since the main difference is in 
the last term, we restrict our attention to 

wt{y):=^ / / pt^siy - x)Gj{x,Us{x))kf^dxds. 
~^ Jo Jr 
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Using Pi := pt-sivi - x) - Pt-s{y2 - x), 



E 



< E 



< E 



Pi Gj{x, Us{x))kl'^ dxds 



Jo JR \ , 



1/2 



{klWe^dxds 



[ \Pl\^/K{l + \us{x)\^)dx] ds 
Jr J 



n/2 



\Pi\^e^^^\^\dxds 



n/2 



yi - y2\ 



where the last step follows from an analogous argument as in the proof of 
Lemma H] and M is given by (|19p. The estimate for fixed y and ti, t2 
arbitrary can be derived similarly. Now the first condition in Assumption 2 
follows from the above argument by taking ^ = 0, while the second condition 
is verified by taking 6 = ^fi. □ 

Suppose tI^'^ is a limit point of {u^'*^} as 0,e — t- 0. By taking limits on 
both sides of ()34p . i^'^ becomes a solution to the following equation, 



<\y) 



Pt{y — x)F{x)dx 



Pt-s{y — x)Gj{x,u^'^ {x))kidxds 



pt{y — x)F{x)dx 



+ 



Pt-s{y — x)G{a, X, u^'^ {x))hs{a)X{da)dxds 



which is the mild form of (jlip . where h = C(^)- The definition of 7 implies 
'y{F, h). Thus, using the above lemma to apply Theorem 6 in [1], the 
rate function for SPDE ([3]) is given as. 



,0,0 



Ku) 



1; 

2 

00 



inf 



\ks\\ids:u = j{F,C{k)) } 3k s.t.u = J (FXik)) 

otherwise. 



15 



By the relationship between k and h, it is easy to see that / coincides 
with rate function / defined by (|12p. This concludes the proof of Theorem 
2. 

Function G{a,x,u) for SBM and FVP satisfies conditions (jH and ([5]); 
hence, by the results attained in this section, to establish the LDP for SBM 
and FVP, one needs only to determine the corresponding rate functions. The 
identification of these rate functions is given in Sections 5 and 6 respectively. 



5 LDP for super-Brownian Motion 

SBM is one of the main models in studying the evolution of populations. 
It assumes that each individual moves randomly according to a Brownian 
motion and she leaves a random number of offsprings upon her death. There- 
fore, SBM is a measure-valued process with an associated branching rate, 
e. Formally speaking, this measure-valued process, also referred to as a su- 
perprocess, is defined as the unique solution, fif, to the following martingale 
problem: for all / G C^(M), 

Mtif) := {fit, f) - (/io, /) - 1^ ^/i^, \Af^ ds, 
is a square-integrable martingale with quadratic variation. 



{Mt{f)) = e [\fil,f)ds. 
Jo 



For more information on this superprocess see [8] and [13]. Our aim in 
this section is to prove the LDP for SBM as the branching rate e is set to 
converge to zero. We define 

Mx)= [ e-^\y\p{x-y)dy (35) 

where p is the mollifier given by 

1 

1-x^ 



p{x) = Kexp{- —) l|^|<i 



and is a constant such that J^p{x)dx = 1. Then for all m E there 
are constants Cm, Cm such that 

(cf. Mitoma [14j . (2.1)). Therefore, we may and will replace e"'^'^' by J/3{x) 
in the definition of M/j (M) given by 1^ . 
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Lemma 6. Let A be the set of all nondecreasing functions, then the map 
^ : Ma,i3nA-^ M^{R) defined as ^{u){A) = J lA{y)du{y) for all A G B{M.), 
is continuous. 

Proof. Suppose — u in the space B^^^ n A. Then for every / G C{,(]R), 

f{x).Ji3{x)i{Un)dx = / f{x)Jp{x)dUn{x) 



{f J p)' {x)Un{x)dx 

if JfsY ix)u{x)dx 
fjp{x)i{u){dx) 

verifying the continuity of ^ map. □ 



Proof of Theorem 3 Recall the definition of u*^ given by (jl3p . By Theo- 
rem 2, u"" satisfies the LDP on C([0, l];Ba_^) and because ul ^ A a.s. for all 
t, we see that obeys LDP on C([0, 1];Bq^/3 n A), as well. Since for SBM, 
^A — ii'^t)^ then by Lemma [6] and the contraction principle, LDP holds for 
/i*^ on C([0, 1]; A^/3(M)) with the rate function determined below. 

If /(/i) < oo, then there exists h G -Z^^([0, 1] x 'K^,dsda) such that (fTTI) 
holds. Let Cc(M) be the collection of functions with compact support on M, 
then for / G Cl{R), 

if^tj) = -{ut,f')L2(^^y 
\Jsmg the controlled version SPDE (llll) . for every f ^ 

i^tj) = -{F,r)- j'^lu'J-i^f'^ds 

/ / hs{a)daf'{y)dyds 

J-oo 



(/"o,/>+ / ( /Us, -A/ ) + / / f{u^ {a))hs{a)dads 
{fJ'0,f) + j (^^^*fJ's,f'^ds + j j^f{y)hs{us{y))dus{y)ds 



(^0,/) + 
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which imphes fi G i/^o and 

{^lt - |A>,) jdy) 

Moreover, 



ht{ut{y)). 



ht{ut{y))f f^t{dy) = / \ht{ut{y))f dut{y) = / \ht{a)f da. 
Jm. Jr 

Denote the right hand side of ([T5]) by /o(^) and observe that in this case, 
/o(//) = /(^). 

If loin) < oo, we may reverse the above calculation to obtain the finite- 
ness of /(/x). This completes the proof of Theorem 3. 



6 LDP for Fleming-Viot 

Besides SBM, FVP is another important model used in population evolution. 
In this model population size stays fixed throughout time and the gene 
mutation and selection of individuals are observed. A rigorous definition for 
Fleming-Viot process is a probability measure- valued process fi^ solving the 
following martingale problem: for all / G C^(M), 

m) ■■= {f^i, f) - (^0, /> - 1^ ^/i^, ^A/^ ds 

is a continuous square-integrable martingale with quadratic variation, 

{Nm = e - {l^s. f?) ds. 

More detailed material on Fleming-Viot process can be found in [2] and [S]. 
This section derives the LDP for Fleming-Viot process as its mutation rate, 
e is set to converge to zero. 

Proof of Theorem 4 Using the same argument as in Section 5, Lemma [6] 
can be proven for FVP by defining a map ■0 : ^a,i3 Ci A ^ 'P^(IR) defined 
as ■0(n)((— oo, y]) = J^^du{y). The continuity of this map can be easily 
verified following the same steps as in Lemma (H therefore, we proceed by 
identifying the rate function. 
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If I{fi) < oo, there exists h £ L^([0, 1] x M+, dsda) such that ([H]) holds. 
For / G C3(M), 



{FJ')-j'^(u',,]^M^ds 



-Us{y) rt r-l 

hs{a)daf'{y)dyds - I {fig, f) / hs{a)dads 
lo JRJo Jo Jo 

(/"o,/) + ^ (^fis,lAf^ds + 1^ lj{u;\a))hs{a)dads 

rt rl 

{^^s,f) / hs{a)dads 
10 Jo 

{fJ'oJ)+j (]^^* Us, ds + j j^f{y)hs{us{y))dus{y)ds 

t r-l 

{fJ-s,f) / hs{a)dads 



Jo 



(/«0,/) + 



* .1 

(/Xs,/) / hs{a)dads 





hence, // E i/^^ and 

('"-'^•'")<**-A,K(,))-/-',,(„w„ 



If /i satisfies (|lip then /is(a) = hs{a) — / hs{a)da also satisfies the same 

/•I 2 /"^ 

equation. To minimize / da^ we choose h such that / hs{a)da = 

Jo Jo 



0. Therefore, /i G -ff^j, and 



ht{ut{y)). 



IJ-My) 

Applying the same argument as in Section 5 establishes Theorem 4. 
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